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WHAT IS CLAIMED IS: 

1. An image processing circuit of an image input device which performs a 
predetermined image processing of image photographed by an image pickup device in 
said image input device, said circuit comprising: 

a real time processing unit in which a predetermined general image processing 
of a pixel data being photographed by said image pickup device and inputted sequentially 
is performed by real time processing; 

a main memory that stores a pixel data outputted from at least said real time 
processing unit, in image frame units; and 

a central control unit in which with respect to image temporarily stored in said 
main memory, exceptional image processing except for said general image processing is 
executed as a software program processing, and then stored in said main memory, 
characterized in that: 

said real time processing unit has at least a selector for selecting said pixel data 
being photographed by said image pickup device and inputted subsequently, and said 
pixel data of image temporarily stored in said main memory. 

2. The image processing circuit according to claim 1 wherein, 

said real time processing unit is formed by connecting sequentially a plurality 
of image processing blocks; 

the foremost stage image processing block is connected such that said pixel 
data of image temporarily stored in said main memory is selectively inputted through said 
selector; 

at least one of the second and later image processing blocks is connected such 
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that said pixel data inputted from the said foremost stage image processing block and a 
pixel data of image temporarily stored in said main memory are selectively inputted 
through a predetermined other selector; 

the rearmost stage image processing block is connected such as to send a pixel 
5 data to said main memory; and 

at least one of the preceding image processing blocks than said the rearmost 
stage image processing block is connected such as to send a pixel data to both the 
succeeding image processing block and said main memory. 

10 3. The image processing circuit according to claim 1 further comprising a 

timing generator for regulating operation timing of said real time processing unit and said 
image pickup device, said timing generator comprising: 

a synchronous control function of regulating synchronously operation timing of 
said real time processing unit and operation timing of said image pickup device, when 

15 said selector selects a pixel data being photographed by said image pickup device and 
inputted sequentially; and 

an asynchronous control function of regulating asynchronously operation 
timing of said real time processing unit and operation timing of said image pickup device, 
when said selector selects a pixel data of image temporarily stored in said main memory. 

20 

4. The image processing circuit according to claim 1 wherein said pixel data 
is inputted repetitively from said main memory to said real time processing unit such as to 
circulate over and over again, when said selector selects a pixel data of image temporarily 
stored in said main memory. 
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5. The image processing circuit according to claim 1 wherein, 

a pixel data to be sent/received among said real time processing unit, said main 

memory and said central control unit is produced by four component data in which a 

predetermined data length is applied to each of four pixel components; and 
. 5 at least one of said four component data is selected an arbitrary component data 

from component data processed by a general image processing in said real time 

processing unit. 



6. The image processing circuit according to claim 1 wherein said real time 
10 processing unit has functions of: 

when a pixel data being photographed by said image pickup device and 
sequentially inputted, or a pixel data from said main memory is a four-color system pixel 
data, storing each of four color component data of said four-color system pixel data in 
said component data; and 
15 when a pixel data being photographed by said image pickup device and 

sequentially inputted, or a pixel data from said main memory is a three-color system pixel 
data, adding, to the fourth color component data, an arbitrary component data processed 
by a general image processing in said real time processing unit, as a predetermined 
feature data of each pixel data, in addition to said three-color system pixel data. 

20 

7. An image processing circuit of an image input device which performs a 
predetermined image processing of image photographed by an image pickup device in 
said image input device, said circuit comprising: 

a real time processing unit in which a predetermined general image processing 
25 of a pixel data being photographed by said image pickup device and inputted sequentially 
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is performed by real time processing; 

a main memory that stores a pixel data outputted from at least said real time 
processing unit, in image frame units; and 

a central control unit in which with respect to image temporarily stored in said 
main memory, exceptional image processing except for said general image processing is 
executed as a software program processing, and then stored in said main memory, 
characterized in that: 

said real time processing unit has a cumulative addition processing function of, 
when each pixel data photographed by said image pickup device and inputted sequentially 
extends multiple frames, repeating, a predetermined number of times, a cumulative 
addition processing in which a pixel data residing on the same position in the preceding 
frame temporarily stored in said main memory is added to each pixel data in each of said 
frames from said image pickup device and the result is stored in said memory. 

8. An image processing circuit of an image input device which performs a 
predetermined image processing of image photographed by an image pickup device in 
said image input device, said circuit comprising: 

a real time processing unit in which a predetermined general image processing 
of a pixel data being photographed by said image pickup device and inputted sequentially 
is performed by real time processing; 

a main memory that stores a pixel data outputted from at least said real time 
processing unit, in image frame units; and 

a central control unit in which with respect to image temporarily stored in said 
main memory, exceptional image processing except for said general image processing is 
executed as a software program processing, and then stored in said main memory, 
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characterized in that: 

said real time processing unit has a circulating addition processing function of, 
when each pixel data photographed by said image pickup device and inputted sequentially 
extends multiple frames, repeating, a predetermined number of times, a circulating 
addition processing in which a pixel data residing on the same position in the preceding 
frame temporarily stored in said main memory and each pixel data in each of said frames 
from said image pickup device are respectively subjected to multiplication with a 
predetermined weighting factor, followed by addition, and the results are stored in said 
memory; and said weighting factor used in said circulating addition processing 

comprising a first factor to be multiplied to a pixel data residing at the same position in 
the preceding frame temporarily stored in said main memory, and a second factor to be 
multiplied to each pixel data in each frame from said image pickup device, said first and 
second factors being set such that the sum of these factors is always one. 

9. An image processing circuit of an image input device which performs a 
predetermined image processing of image photographed by an image pickup device in 
said image input device, said circuit comprising: 

a real time processing unit in which a predetermined general image processing 
of a pixel data being photographed by said image pickup device and inputted sequentially 
is performed by real time processing; 

a main memory that stores a pixel data outputted from at least said real time 
processing unit, in image frame units; and 

a central control unit in which with respect to image temporarily stored in said 
main memory, exceptional image processing except for said general image processing is 
executed as a software program processing, and then stored in said main memory. 
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characterized in that: 

said real time processing unit has a pixel compensation function with which 
each pixel data photographed by said image pickup device and inputted sequentially is 
multiplied by a predetermined pixel compensation parameter previously stored in said 
- 5 main memory, for a predetermined pixel compensation including shading compensation. 

10. An image processing circuit of an image input device which performs a 

predetermined image processing of image photographed by an image pickup device in 

said image input device, said circuit comprising: 
10 a real time processing unit in which a predetermined general image processing 

of a pixel data being photographed by said image pickup device and inputted sequentially 

is performed by real time processing; 

a main memory that stores a pixel data outputted from at least said real time 

processing unit, in image frame units; and 
15 a central control unit in which with respect to image temporarily stored in said 

main memory, exceptional image processing except for said general image processing is 

executed as a software program processing, and then stored in said main memory, 

characterized in that: 

said real time processing unit has a function of selecting at least said 
20 cumulative addition processing function as defined in claim 7, and said circulating 

addition processing function as defined in claim 8. 
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11. An image processing circuit of an image input device which performs a 
predetermined image processing of image photographed by an image pickup device in 
said image input device, said circuit comprising: 
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a real time processing unit in which a predetermined general image processing 
of a pixel data being photographed by said image pickup device and inputted sequentially 
is performed by real time processing; 

a main memory that stores a pixel data outputted from at least said real time 
- 5 processing unit, in image frame units; and 

a central control unit in which with respect to image temporarily stored in said 
main memory, exceptional image processing except for said general image processing is 
executed as a software program processing, and then stored in said main memory, 
characterized in that: 

10 said real time processing unit has a function of selecting said cumulative 

addition processing function as defined in claim 7, said circulating addition processing 
function as defined in claim 8, and said pixel compensation function as defined in claim 
9. 

15 12. The image processing circuit according to claim 1 wherein said real time 

processing unit further comprising: 

a pixel reference block having a 3 X 3 pixel registers and two line memories, in 
which, to an objective pixel residing at the center of said 3X3 pixel registers, a reference 
is made from pixels surrounding said objective pixel; and 

20 a color selection block performing pixel interpolation about a color component, 

to said objective pixel in said pixel reference block, characterized in that: 

said color selection block having a function of performing pixel interpolation, 
(i) when each pixel residing in said pixel reference block is of a 2 X 2 pixel array of four- 
color system, by using a first arithmetic processing in which a similar interpolation is 

25 conducted pixel by pixel, and (ii) when each pixel residing in said pixel reference block is 
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of a pixel array of three-color system, by using a second arithmetic processing in which 
one component of a pixel in said three-color system is used as a fourth color pixel of a 2 
X 2 pixel array similar to said four-color system, so that interpolation differs between one 
said component and other component is conducted. 

5 

13. The image processing circuit according to claim 12 wherein, 

said pixel array of three-color system is a RGB-Bayer produced by red, green 
and blue components; and 

said color selection block in said real time processing unit has a function of 

10 performing pixel interpolation in which, when each pixel residing in said pixel reference 
block is of a RGB-Bayer, said green component is used as a fourth color pixel of a 2X2 
pixel array similar to said four-color system, so that said green component is disposed 
diagonally, and a pixel interpolation processing of interpolating said green component to 
other component is performed by finding a mean value of said green components in four 

15 pixels residing in both longitudinal and transverse directions of an objective pixel being 
other component, alternatively, by finding a mean value of two pixels that are obtained by 
eliminating the minimum and maximum values of said green components of four pixels 
residing in both longitudinal and transverse directions of an objective pixel being other 
component. 

20 

14. The image processing circuit according to claim 1 wherein, 

said real time processing unit further comprises an auto focus evaluation block 
from which a high-frequency component evaluation value is outputted as an evaluation 
value used in an appropriate evaluation for auto focusing, said evaluation value being 
25 obtained by integration of the absolute value of a difference in a plurality of adjacent 



82 

pixels having a predetermined identical component, with respect to a given region in a 
pixel array of image, said auto focus evaluation block comprising: 

a selector capable of selectively changing a clearance timing between a pair of 
pixels which are identical in component and objects for obtaining a difference; 
5 an arithmetic circuit for calculating the absolute value of a difference between a 

pair of pixels which are identical in component and spaced at a clearance timing selected 
by said selector; and 

a cumulative adder in which cumulative addition of absolute values 
sequentially outputted from said arithmetic circuit is performed a given number of times. 

10 

15. An image processing circuit of an image input device which performs a 
predetermined image processing of image photographed by an image pickup device in 
said image input device, said circuit comprising: 

a real time processing unit in which a predetermined general image processing 
15 of a pixel data being photographed by said image pickup device and inputted sequentially 
is performed by real time processing; and 

a main memory that stores a pixel data outputted from at least said real time 
processing unit, in image frame units, and wherein, 

said real time processing unit further comprises a defective pixel compensation 
20 block that reads defective pixel addresses stored in said main memory disposed outside of 
said real time processing unit, and performs defective pixel compensation when a pixel 
address of a pixel data residing in image matches said defective pixel address. 

16. The image processing circuit according to claim 15 wherein, 

25 when a plurality of defective pixel addresses are present in said main memory. 
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said defective pixel addresses are stored in the order of a pixel array sequence; 

said defective pixel compensation block of said real processing unit comprises: 

a shift register with a plurality of registers connected in series, to which 
defective pixel addresses stored in said main memory are inputted sequentially; and 

a comparator connected to the rearmost stage of said shift register in which an 
address count value of a pixel data inputted sequentially is compared with a defective 
pixel address provided from the said rearmost stage and, when a match is found, a 
defective pixel timing signal is outputted, characterized in that: 

said shift register holds a defective pixel address, and output of the said 
rearmost stage is looped to an input terminal of the foremost stage; 

said comparator is a comparator in which an address count value of a pixel data 
inputted sequentially is compared with a defective pixel address provided from the said 
rearmost stage and, when a match is found, a shift timing signal and a defective pixel 
timing signal are outputted; and 

shift of said shift register is executed by said shift timing signal provided from 
said comparator. 

17. An image processing circuit of an image input device which performs a 
predetermined image processing of image photographed by an image pickup device in 
said image input device, said circuit comprising: 

a real time processing unit in which a predetermined general image processing 
of a pixel data being photographed by said image pickup device and inputted sequentially 
is performed by real time processing; 

a main memory that stores a pixel data outputted from at least said real time 
processing unit, in image frame units; and 
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a central control unit in which with respect to image temporarily stored in said 
main memory, exceptional image processing except for said general image processing is 
executed as a software program processing, and then stored in said main memory, 
characterized in that: 

said real time processing unit further comprises: 

a gamma compensation table capable of performing, when given a N-bit length 
pixel data, gamma compensation processing about said pixel data; and 

a selector in which, when given a N-bit length pixel data, said pixel data is 
inputted to said gamma compensation table; and when given a (N-2)-bit length pixel data, 
switching is made so that four data rows sequentially provided as a (N-2)-bit length pixel 
data, are respectively inputted to four look-up tables obtained by dividing said gamma 
compensation table into four. 

18. The image processing circuit according to claim 1 wherein said real time 
processing unit comprises: 

a color space transformation circuit on which a pixel data of a first array system 
having a predetermined color component array is transformed to a second array system 
pixel data having a predetermined special color component; 

a special color look-up table in which only said predetermined special color 
component in said second array system pixel data transformed on said color space 
transformation circuit is inputted for numerical transformation with a predetermined 
function, and the result is outputted; and 

a multiplier in which components other than said predetermined special color 
component in said second array system pixel data are respectively multiplied by a value 
outputted from said special color look-up table. 
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19. The image processing circuit according to claim 12 wherein said real time 
processing unit comprises: 

a selector that selects a high-frequency component signal of green component 
- 5 obtained on said pixel reference block in said color selection block, and the fourth color 
pixel stored in said main memory; 

a feature data look-up table in which data selected by said selector is inputted as 
a feature data, for numerical transformation with a predetermined function, and the result 
Q is outputted; and 

10 a multiplier in which each component of a pixel data of a predetermined pixel 

L i 

f£ array is multiplied by a value outputted from said feature data look-up table. 



20. The image processing circuit according to claim 12 wherein said real time 
processing unit comprises: 
15 a selector that selects the fourth color pixel of each pixel that is stored in said 

pixel reference block in said color selection block, alternatively, provided from said 
image pickup device, and a pixel of one component in said three-color system pixel 
employed as a fourth color pixel of a 2 X 2 pixel array when handling said three-color 
system pixel array; 

20 a feature data look-up table in which a pixel selected by said selector is inputted 

as a feature data, for numerical transformation by a predetermined function, and the result 
is outputted; and 

a multiplier in which each component of a pixel data of a predetermined pixel 
array is multiplied by a value outputted from said feature data look-up table. 
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21. The image processing circuit according to claim 12 wherein said real time 
processing unit comprises: 

a color space transformation circuit on which a first array system pixel data 
having a predetermined color component array is transformed to a second array system 
5 pixel data having a predetermined special color component; and 

a selector performing switching as to whether the fourth color pixel data 
outputted from said color selection block, or data of one component in said first array 
system pixel data is allowed to be inputted to said color space transformation circuit, 
characterized in that: 

10 said color space transformation circuit having a function of, when said selector 

allows data to be inputted to said color space transformation circuit, transforming said 
data thus allowed to said second array system pixel data, as a fourth color pixel data. 




22. The image processing circuit according to claim 1 wherein, 
15 said real time processing unit further comprises an exposure determination 

evaluating unit in which an image frame is divided into multiple blocks of at least 3X3, 
and the integral value of a special color component of the preceding pixel in each block is 
obtained to output an evaluation value used in exposure determination when 
photographing with said image pickup device, characterized in that: 
20 said exposure determination evaluating unit can arbitrarily change the border 

line between blocks in both longitudinal and transverse directions. 
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23. The image processing circuit according to claim 1 wherein said real time 
processing unit further comprises: 

a spatial filter that processes a data constellation in a predetermined color 



87 

space; and 

a contour correction block on which only a component after frequency 
conversion in said data constellation in said spatial filter, is subjected to gain adjustment 
for contour correction processing, characterized in that: 
5 said contour correction block has a function of outputting, as an individual data, 

data obtained by performing gain adjustment only to a component after frequency 
conversion in said data constellation in said spatial filter, and original data in said spatial 
filter. 




10 24. The image processing circuit according to claim 23 wherein said real time 

processing unit further comprises: 

a coring function block that removes noise component in image during contour 

correction processing in said contour correction block, by outputting, only when said 

high-frequency special color component has an amplitude smaller than a predetermined 
15 threshold width, said amplitude regarding as being zero, by using a predetermined linear 

operation function; and 

a reverse gamma effect block that relatively changes an amplitude ratio of said 

high-frequency special color component, with respect to said predetermined threshold 

width in said coring function block, characterized in that: 
20 said revere gamma effect block determines said ratio by a predetermined ratio 

transform function, based on a special color component of an original data provided from 

said spatial filter; and 

said predetermined ratio transform function is set so that said amplitude ratio of 

said high-frequency special color component with respect to said predetermined threshold 
25 width, is gradually increased as the amount of said special color component of said 
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original data is larger. 

25. The image processing circuit according to claim 23 wherein, 

said data constellation of said spatial filter in said real time processing unit is 
5 configured as a three-component data integration; and 

said real time processing unit can selectively perform a three-component output 
or four-color component output to said main memory and, in either case, can selectively 
output three components in said spatial filter and one component of a special color 
component after frequency conversion, with respect to at least output of one component. 

10 

26. The image processing circuit according to claim 1 wherein, 

when employing, as said image pickup device, an interlace type one in which 
even lines and odd lines are read out as two fields at a different timing, respectively, a 
first field pixel data related to either said even lines or said odd lines is stored in said 

15 main memory; and 

said real time processing unit performs, when a second field pixel data related 
to either said even lines or said odd lines is inputted sequentially from said image pickup 
device, a predetermined image processing including pixel interpolation, color space 
transformation and contour correction processing, by reading and referring to said first 

20 field pixel data of said main memory that corresponds to said second field pixel data, in 
synchronization with input of said second field pixel data. 
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27. The image processing circuit according to claim 1 wherein, 
said real time processing unit has a line memory storing a predetermined 
number of pixel data per line; 
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said main memory stores image in frame units to be provided from said image 
pickup device; 

said real time processing unit, when the number of pixels per line, 
photographed by said image pickup device, is greater than the number of pixel data in 
said line memory, divides horizontally said image in frame units to be outputted from said 
main memory into multiple blocks; and 

image data related to said image divided into said multiple blocks in said main 
memory is inputted sequentially to said line memory in said real time processing unit. 



